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ABSTRACT 

The  purpose  of  this  thesis  was  to  present  the  procedure 
and  techniques  used  to  select  the  fourth  annual  recipient  of 
the  Rear  Admiral  John  J.  Shieffelin  Award  for  Excellence  in 
Teaching.   The  data  and  results  were  analyzed  and  compared 
with  the  results  from  the  previous  year.   Findings  indicate 
that  the  best  teacher  in  each  of  the  eleven  academic  depart- 
ments is  being  selected  but  that  distribution  of  the  eleven 
within  the  top  twenty  positions  occurs  randomly. 

Recommendations  were  made  for  changes  in  the  present 
system  should  it  continue  in  use  and  an  additional 
recommendation  was  made  for  the  adoption  of  a  new  method  of 
selection  based  on  the  use  of  student  questionnaires. 
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I.   INTRODUCTION 

In  May  1969,  the  Superindendent  of  the  U.S.  Naval  Post- 
graduate School  directed  that  a  committee  be  formed  each 
year  from  among  the  faculty  to  select  the  recipient  of  an 
excellence  in  teaching  award  to  be  known  as  the  Rear  Admiral 
John  J.  Shieffelin  Award.   The  committee  was  to  be  composed 
of  a  chairman,  a  secretary,  and  five  members,  all  of  whom 
would  be  chosen  to  represent  a  variety  of  backgrounds  and 
curricula.   In  order  to  retain  a  degree  of  continuity  within 
the  committee,  only  four  of  its  members  would  be  replaced 
each  year. 

The  1973  committee  consisted  of  the  following  faculty 
members: 

G.J.  Hokenson  -  Chairman 

N.  Plotkin     -  Secretary 

D.E.  Harrison  -  Member 

H.J.  Zweig     -  Member 

J.N.  Dyer      -  Member 

R.  Stolfi      -  Member 

H.J.  Larson    -  Member 
The  following  guidelines  for  the  selection  process  were 
adopted  by  the  committee: 

1.   All  faculty  members  who  taught  two  or  more  course 
segments  in  1972  were  eligible  to  receive  the  award  with 
the  exception  of  members  of  the  selection  committee,  curric- 
ular  and  liaison  officers,  and  previous  award  winners. 
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2.  The  voting  population  would  consist  of  all  current 
students,  faculty,  curricular  officers  and  the  Naval  officer 
alumni  who  were  graduated  in  1971. 

3.  Participation  in  the  voting  would  be  on  a  voluntary 
basis. 

4.  Care  and  discretion  would  be  exercised  to  insure 
that  no  ranking  of  candidates  was  published. 

5.  For  the  ballot  to  be  valid,  the  voter  must  indicate 
on  the  candidate  list  at  least  five  members  of  the  faculty 
with  whom  he  is  sufficiently  acquainted  to  make  a  judgment. 

6.  Should  the  committee  be  unable  to  decide  upon  a 
single  dominant  winner,  equal  multiple  awards  would  be 
presented  not  to  exceed  three  in  number. 

In  order  to  maintain  complete  objectivity  among  the 
selection  committee  it  was  decided  that  handling  of  all 
ballots  and  collation  of  all  data  would  be  performed  by  a 
graduate  student  who  would  then  submit  the  results  to  the 
committee  for  its  selection.   The  winner's  name  would  remain 
secret  until  the  award  was  presented  at  the  June  1973  gradu- 
ation exercises. 


II.   THE  BALLOT 

A.   FORMAT 

The  ballot  adopted  by  the  committee  for  this  year's 
polling  was  similar  to  those  used  in  previous  years  but  in- 
cluded minor  modifications  based  on  recommendations  made  the 
previous  year.   Students,  faculty,  and  curricular  officers 
each  received  a  ballot  and  return  envelope  to  which  was 
attached  a  cover  sheet  which  explained  the  purpose  of  the 
award  and  provided  instructions  on  completing  the  ballot. 
In  addition  to  the  ballot  and  cover  sheet,  alumni  received 
an  additional  cover  letter  from  the  Superintendent. 

The  ballot  was  composed  of  four  parts.   Part  A  consisted 
of  information  useful  for  gathering  statistics  concerning 
voter  characteristics.   The  voter  was  asked  to  identify  his 
voter  category,  branch  of  service,  military  rank  and  curric- 
ular area  if  military  or  a  civilian  student;  if  a  member  of 
the  faculty  his-  rank  and  department  were  to  be  indicated. 

.  Part  B  consisted  of  three  blanks  to  be  used  in  indicat- 
ing first,  second,  and  third  choices  for  the  award  using  the 
four-digit  identification  number  specified  in  Part  C. 

Part  C  consisted  of  the  list  of  all  eligible  faculty 
members.   Members  were  listed  in  alphabetical  order  within 
departments  and  each  name  was  preceded  by  a  four-digit 


A  sample  ballot,  cover  letter,  and  instruction  sheet 
are  included  in  Appendix  A. 


identification  number.   The  number  of  each  faculty  member 
with  whom  the  voter  was  academically  well  acquainted  was  to 
be  circled.   From  this  field  of  selected  individuals,  the 
voter  was  then  to  select  from  one  to  three  nominees  and 
place  their  identification  numbers  in  the  blanks  provided 
in  Part  B. 

Part  D  was  an  optional  area  in  which  the  voter  could 
provide  remarks  for  supporting  his  first  place  nomination. 

B.  BALLOT  DISTRIBUTION 

Ballots  were  distributed  to  most  students  by  placing  an 
empty  ballot  in  each  student  mail  center  box.   NMSC  students 
received  ballots  in  the  classroom.   Alumni  who  were  gradu- 
ated in  1971  were  selected  to  participate  in  the  voting  and 
their  names  and  addresses  were  obtained  from  a  data  tape 
maintained  in  the  computer  facility.   Faculty  member  ballots 
were  placed  in  faculty  mail  center  boxes  within  each  curric- 
ulum office.   Completed  ballots  were  placed  in  the  return 
envelopes  provided  and  mailed  to  Code  55  BAL.   When  received, 
the  ballots  were  forwarded  to  a  central  location  in  the 
Operations  Analysis  Department. 

C.  BALLOT   VALIDATION 

The  validation  process  consisted  of  insuring  that  the 
voter's  signature  was  on  the  envelope  and  that  the  identifi- 
cation numbers  of  at  least  five  faculty  members  in  Part  C 
were  circled.   If  the  envelope  was  unsigned  or  less  than 
five  faculty  members  in  Part  C  were  identified,  the  ballot 
was  considered  void  and  eliminated  from  further  consideration, 
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Write-in  votes  in  Part  B  were  not  considered.   If  Part  B 
consisted  of  only  write-in  votes  the  ballot  was  considered 
void.   If  Part  B  consisted  of  a  combination  of  write-in 
votes  and  valid  identification  numbers,  the  write-in  votes 
were  ignored.   If  an  identification  number  appeared  more 
than  once  in  Part  B,  only  its  first  appearance  was  counted. 
Each  valid  ballot  was  given  a  four  digit  identification 
number  for  ease  of  handling  and  future  reference. 

Of  the  1292  ballots  returned,  335  were  void,  which  is  a 
larger  percentage  than  occurred  in  1972.   The  number  of  void 
ballots  in  each  voter  category  and  the  reasons  for  disquali- 
fication are  as  follows: 
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Failure  to  identify  5  faculty  members 
Failure  to  complete  Part  B 
Completed  Part  B  with  write-in  votes 
Received  too  late' to  be  processed 

D.       TRANSFERRING   THE    DATA    TO  COMPUTER    TAPE 

Upon  completion  of  the  validation  process,  the  informa- 
tion on  each  valid  ballot  was  transferred  to  an  IBM  card  in 
order  that  it  could  be  processed  by  a  series  of  prepared 
computer  programs.   The  first  of  these  was  a  COBOL  routine 
called  "Transfer"   which  checked  each  IBM  card  for  possible 


2 

A  listing  of  "Transfer"  is  included  in  Appendix  B, 


errors.   The  most  frequent  source  of  error  would  naturally 
arise  from  a  typographical  mistake  in  one  of  the  four-digit 
faculty  identification  numbers.   These  numbers  were  assigned 
with  this  fact  in  mind  and  they  were  specifically  devised  so 
that  a  computer  routine  could  be  used  to  easily  check  their 
accuracy.   Each  instructor  on  the  ballot  was  assigned  a 
three-digit  number  which  formed  a  vector.   This  vector  was 
then  multiplied  by  a  fixed  weighting  vector  to  form  an  inner 
product,  the  last  digit  of  which  formed  the  fourth  digit  of 
the  final  identification  number.   For  example,  professor 
number  629,  when  multiplied  by  the  weighting  vector  yields: 

'3\ 

=  18  +  10  +  9  =  37 


Thus,  the  final  identification  number  would  be  6297. 

When  an  error  was  detected,  "Transfer"  identified  the 
error  and  the  ballot  on  which  it  occurred  in  order  that  it 
could  be  corrected  and  resubmitted.   Those  ballots  found  to 
be  error  free  were  transferred  to  a  magnetic  tape  for 
further  processing.   This  procedure  was  continued  until  all 
ballots  were  transferred  to  the  tape. 
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Student 

1572 

764 

48.5 

Alumnus 

747 

407 

54.5 

Faculty 

305 

109 

35.8 

Cur r. Off . 

17 

12 

70.5 

III.       STATISTICAL  ANALYSIS 

A.       POPULATION  CHARACTERISTICS 

Table  I  compares  voter  response  within  each  voter  cate- 
gory with  that  response  received  in  1972. 

Table  I.   VOTER  RESPONSE 

#  ELIGIBLE   #  BALLOTS   %  RETURNED     %  CHANGE  OVER 
CATEGORY      VOTERS     RETURNED  FROM  ELIGIBLE   PREVIOUS  YEAR 

+  2.5 
-12.7 
-  6.1 
+33.0 

The  figures  indicate  that  alumnus  and  faculty  response 
percentages  have  decreased  from  the  previous  year  while 
student  response  has  increased  slightly  and  the  percentage 
of  curricular  officers  responding  has  increased  substantial- 
ly.  However,  the  valid  voter  response  figures  shown  in 
Table  II  indicate  that  this  slight  increase  in  the  number  of 
overall  responses  was  more  than  negated  by  the  considerable 
increase  in  void  ballots  received,  (335  vs.  148).   It 
appears  that  additional  effort  must  be  made  to  not  only 
encourage  increased  voter  response,  but  also  to  insure  that 
ballots  are  filled  out  correctly. 

Table  II.   VALID  VOTER  RESPONSE 

CATEGORY   #  ELIGIBLE  #    VALID      %   VALID      %  CHANGE  OVER 
VOTERS    BALLOTS   FROM  ELIGIBLE   PREVIOUS  YEAR 

-  6.1 
-19.6 

-  7.2 

+  4.0 
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Student 

1572 

554 

35.2 

Alumnus 

747 

314 

42.1 

Faculty 

305 

83 

27.2 

Curr.Off . 

17 

6 

35.3 

B.   DISTRIBUTION  OF  M± 

After  all  ballots  had  been  placed  on  magnetic  tape,  a 

3 

second  COBOL  program,  "Profsort"  ,  was  run  which  rearranged 

the  data  from  ballot  format  into  a  statistical  record  for 
each  faculty  member.   The  program  then  identified  the  fre- 
quency distribution  of  M . ,  the  number  of  faculty  members 

th 
known  by  the  1    voter.   Table  III  presents  a  frequency 

table  of  M. .   The  mean  of  M.    =    16.1  with  a  standard  devia- 
1  a 

tion  of  9.7.   An  interesting  fact  to  note  is  that  in  all 
cases  where  a  voter  identified  55  or  more  faculty  members 
with  whom  he  was  sufficiently  familiar  to  judge  as  an  in- 
structor, the  voter  was  himself  a  member  of  the  faculty. 


Table  III.   FREQUENCY  TABLE  OF  Mi 
CELL  FREQUENCY 


5-9  236 

10-14  266 

15-19  181 

20-24  137 

25-29  80 

30-34  28 

35-39  14 

40-44  3 

45-49  5 

50-54  2 

55-59  1 

60-64  1 

65-69  0 

70-74  1 

75-79  0 

80-84  0 

85-89  0 

90-94  0 

95-99  1 

100-104  0 

105-109  0 

110-114  1 

115-120  2 
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A  listing  of  "Profsort"  is  included  in  Appendix  B, 
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C.   DISTRIBUTION  OF  NR 

Once  "Prof sort"  had  established  a  distribution  of  M-  and 

compiled  a  statistical  record  for  each  faculty  member  on  a 

4 
new  magnetic  tape,  a  third  COBOL  program,  "Scorsort"   was 

run  which  provided  a  frequency  distribution  of  N^,  the 

number  of  voters  who  knew  the  k    professor.   The  mean  of  N^ 

was  determined  to  be  53.4  with  a  standard  deviation  of  50.7. 

Table  IV  is  a  frequency  table  of  N  . 

Table  IV.   FREQUENCY  TABLE  OF  NR 

CELL  FREQUENCY 

1-20  28 

21-40  88 

41-60  74 

61-80  39 

81-100  33 

101-120  10 

.121-140  10 

141-160  0 

161-180  1 

181-200  1 


D.   DETERMINATION  OF  SR 

In  addition  to  calculating  N  ,  "Scorsort"  calculated  a 

numerical  score  for  each  faculty  member  and  provided  the 

following  statistics: 

xlk  =  Number  of  1st  place  votes  received  by  professor  k 
^2k  =  Number  of  2nd  place  votes  received  by  professor  k 
^3k  =  Number  of  3rd  place  votes  received  by  professor  k 

Scores  were  calculated  in  the  following  manner: 

A  weighting  vector  W  =  (4,2,1)  was  multiplied  by 


A  listing  of  "Scorsort"  is  included  in  Appendix  B. 
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^ik  th 

V.   =  ■  ..   =  fraction  of  i    place  votes  to  teacher  K  from 
ik     Nk 

the  population  that  knew  him;  i=l,2,3;  k=l,2,... 
:Vlk  V2k  V3k  )   I  2  I  =  4  Vlk  +  2  V2k  +  V3k 


For  example,  suppose  a  faculty  member  were  known  by  40 
students  and  received  four  first  place  votes,  two  second 
place  votes  and  one  third  place  vote.   His  score  would  be 
calculated  as  follows: 


_  4       _  2        _  1 

lk~  40  '  V2k~  40  '  V3k~  40 


Score  =  (A^^_)   |2J  =  .52500 

Table  V  presents  the  scores  in  descending  order  with  the 
corresponding  values  of  N,  ,  X,,  ,  ^k'  anc^  X3k  ^or  eacn 
faculty  member. 

E.   DOMINANCE 

In  calculating  the  numerical  scores  of  each  candidate, 
it  was  decided  that  a  first  place  vote  should  be  worth  more 
than  a  second  place  vote  which  should  be  worth  more  than  a 
thrid  place  vote.   Consequently,  a  weighting  vector  w"  = 
(4,2,1)  was  chosen  for  use  and  the  scores  were  calculated 
using  these  figures.   However,  it  might  be  possible  that 
some  other  W  than  the  one  used  could  be  chosen  which  retained 
the  relationship  w  >w>w  but  this  would  result  in  a  differ- 
ent ordering  of  faculty  member  scores. 

Recall  that  the  score  of  teacher  K,  S,  ,  was  calculated 

k 

by  multiplying  the  weighting  vector  (W)  by  V.  ,  the  vector 
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Table    V.       SCORSORT   SUMMARY 


k 

sk 

\ 

X 

Ik 

X2k 

X 

3k 

1 

1.93333 

30 

9 

9 

4 

2 

1.87179 

39 

15 

5 

3 

3 

1.65385 

26 

7 

6 

3 

4 

1.64103 

39 

12 

4 

8 

• 

1.60448 

134 

35 

30 

15 

• 

1.59459 

37 

9 

8 

7 

• 

1.58065 

93 

24 

19 

13 

1.48438 

64 

20 

6 

3 

1.42157 

102 

27 

14 

9 

1.41912 

136 

34 

22 

13 

1.35897 

39 

9 

6 

5 

1.32653 

49 

12 

5 

7 

1.31250 

48 

10 

6 

11 

1.25806 

31 

8 

2 

3 

1.22222 

36 

7 

6 

4 

1.20833 

72 

16 

8 

7 

1 . 20000 

20 

3 

5 

2 

1.17391 

23 

5 

3 

1 

1.12360 

89 

19 

8 

8 

1.11111 

45 

8 

7 

4 

1.10638 

47 

8  . 

8 

4 

• 

1.10219 

137 

25 

18 

15 

• 

1.08000 

50 

8 

10 

2 

• 

1.04167 

48 

10 

4 

2 

25 

1.03226 

31 

6 

2 

4 
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Table    V.       SCORSORT   SUMMARY    (continued) 


k 
26 


50 


1.02778 
1.02222 
1 . 00000 
0.9708  7 
0.93939 
0,93939 
0.93750 
0.92929 
0.91803 
0.91429 
0.91139 
0.87952 
0.87805 
0.84211 
0.82759 
0.82143 
0.80435 
0.80000 
0.79487 
0.79310 
0.78947 
0.76364 
0.75676 
0.74074 
0.73529 


\ 

36 
45 
55 
103 
66 
33 
48 
99 
122 
105 
79 
83 
41 
19 
29 
56 
46 
75 
39 
29 
95 
55 
37 
27 
34 


Ik 

7 

9 

8 
18 

8 

5 

8 
12 
21 
17 
10 
10 

6 

2 

4 

8 

5 
10 

5 

5 
13 

4 

3 

4 

5 


X 
2k 

3 

2 

9 

9 
12 

4 

5 
18 

9 
10 
12 
14 

5 

4 

3 

6 

4 

8 

4 

1 

6 

9 

6 

2 

1 


3k 
3 

6 

5 
10 

6 

3 

3 

8 
10 

8 

8 

5 

2 

0 

2 

2 

9 

4 

3 

1 
11 

8 

4 

0 

3 
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Table  V.   SCORSORT  SUMMARY  (continued) 


k 

\ 

N 
k 

X 

Ik 

X2k 

X31 

51 

0.72527 

91 

11 

7 

8 

• 

0.71429 

84 

7 

10 

12 

• 

0.71233 

73 

9 

5 

6 

• 

0.70370 

27 

3 

3 

1 

0.68966 

58 

8 

3 

2 

0.68750 

64 

7 

7   v 

2 

0.67500 

40 

4 

2 

7 

0.66667 

12 

2 

0 

0 

.   0.66000 

50 

4 

7 

3 

0.63636 

22 

1 

4 

2 

0.63158 

57 

7 

2 

4 

0.62590 

139 

11 

12 

19 

0.62500 

24 

2 

2 

3 

0.60317 

63 

5 

7 

4 

0.60000 

50 

4 

4 

6 

0.60000 

20 

1 

4 

0 

0.58947 

95 

9 

5 

10 

0.58537 

41 

4 

3 

2 

0.58228 

79 

8 

5 

4 

0.57971 

69 

7 

4 

4 

0.57447 

47 

2 

8 

3 

• 

0.56757 

37 

4 

2 

1 

• 

0.56716 

134 

10 

13 

10 

• 

0.56098 

41 

4 

3 

1 

75 

0.55882 

34 

3 

2 

3 

17 


Table  V.   SCORSORT  SUMMARY  (continued) 


k 
76 


100 


k 

0.54839 

0.54762 
0.54286 
0.54286 
0.54167 
0.50000 
0.50000 
0.50000 
0.50000 
0.49057 
0.47917 
0.47458 
0.46988 
0.46875 
0.46269 
0.46154 
0.45833 
0.43750 
0.43750 
0.43182 
0.42353 
0.42308 
0.42105 
0.41026 
0.40278 


\ 

31 
42 
35 
35 
48 
104 
40 
34 
28 
53 
96 
59 
83 
32 
67 
39 
48 
64 
48 
44 
85 
78 
19 
39 
72 


X 


Ik 
2 

4 

3 

3 

4 

9 

3 

2 

2 

2 

6 

3 

6 

3 

4 

3 

1 

5 

3 

2 

4 

5 

0 

2 

3 


X 


2k 
3 

3 

3 

1 
4 
4 
3 
3 
1 
6 
8 
6 
4 
1 
4 
2 
7 
1 
3 
4 
8 
5 
4 
2 
6 


X 


3  k 
3 

1 

1 

5 

2 

8 

2 

3 

4 

6 

6 

4 

7 

1 

7 

2 

4 

6 

3 

3 

4 

3 

0 

4 

5 
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Table    V.       SCORSORT   SUMMARY    (continued) 


k 

Sk 

\ 

X 
Ik 

X 
2k 

X 
3k 

101 

0.40000 

25 

2 

1 

0 

• 

0.39344 

61 

3 

4 

4 

• 

0.38554 

83 

3 

8 

4 

• 

0.38462 

26 

1 

2 

2 

0.38272 

81 

3 

4 

11 

0.38158 

76 

4 

•   6 

1 

0.38095 

63 

3 

2 

8 

0.37931 

29 

2 

1 

1 

0.36667 

30 

1 

2 

3 

0.36585 

82 

5 

2 

6 

0.36364 

44 

3 

2 

0 

0.36111 

36 

2 

2 

1 

0.35714 

28 

2 

1 

0 

0.35714 

28 

1 

2 

2 

0.35294 

102 

2 

7 

14 

0.35294 

34 

1 

3 

2 

0.34848 

66 

2 

6 

3 

0.34211 

38 

2 

1 

3 

0.34091 

44 

2 

3 

1 

0.34043 

47 

2 

3 

2 

0.33663  - 

101 

4 

3 

12 

• 

0.33333 

33 

2 

1 

1 

• 

0.33333 

27 

1 

2 

1 

• 

0.33333 

24 

2 

0 

0 

125 

0.32653 

49 

3 

2 

0 
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Table  V.   SCORSORT  SUMMARY  (continued) 


k 

sk 

N 
k 

X 
Ik 

X 
2k 

X 
3k 

126 

0.32609 

46 

1 

4 

3 

• 

0.32500 

40 

1 

3 

3 

• 

0.32500 

40 

2 

2 

1 

• 

0.32203 

59 

2 

3 

5 

0.31250 

32 

2 

0 

2 

0.30488 

82 

3 

4 

5 

0.30000 

10 

0 

1 

1 

0.29730 

37 

0 

5 

1 

0.29730 

37 

1 

2 

3 

0.29412 

34 

1 

2 

2 

0.28125 

96 

3 

5 

5 

0.28000 

50 

1 

3 

4 

0.27869 

61 

0 

5 

7 

0.27835 

97 

5 

3 

1 

0.27778 

72 

2 

4 

4 

0.27551 

98 

2 

6 

7 

0.27439 

164 

6 

8 

5 

0.26596 

94 

3 

4 

5 

0.26316 

38 

1 

2 

2 

0.25974 

77 

2 

3 

6 

0.25714 

105 

3 

6 

3 

• 

0.25641 

39 

2 

1 

0 

• 

0.25490 

51 

3 

0 

1 

• 

0.25000 

84 

3 

4 

•  1 

150 

0.25000 

40 

2 

1 

0 
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Table    V.       SCORSORT   SUMMARY    (continued) 


k 

151 


N 


175 


k 

k 

0.24390 

41 

0.22581 

124 

0.22222 

54 

0.22222 

54 

0.22222 

36 

0.22222 

18 

0.22000 

50 

0.21951 

41 

0.21875 

64 

0.21795 

78 

0.21429 

28 

0.21154 

52 

0.21053 

19 

0.20755 

53 

0.20690 

29 

0.20661 

121 

0.20588 

34 

0.20482 

83 

0.20000 

95 

0.20000' 

80 

0.20000 

40 

0.19853 

136 

0.19737 

76 

0.19444 

36 

0.19231 

26 

Ik 

1 

4 
2 
1 
0 
1 
0 
1 
2 
3 
0 
1 
0 
1 
1 
1 

o 

3 
2 
3 
2 
3 
2 
1 
1 


2k 
2 

4 

2 

2 

3 

0 

3 

2 

2 

1 

2 

3 

1 

2 

0 

8 

2 

2 

4 

1 

0 

7 

1 

1 

0 


X 


3k 
2 

4 

0 

4 

2 

0 

5 

1 

2 

3 

2 

1 

2 

3 

2 

5 

3 

1 

3 

2 

O 

1 

5 

1 

1 
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Table  V.   SCORSORT  SUMMARY  (continued) 


k 
176 


200 


k 

Oo 19048 

0.18367 
0.17241 
0.17073 
0.16667 
0.16396 
0.16129 
0.16129 
0.16129 
0.15854 
0.15152 
0.15000 
0.14773 
0.14667 
0.14545 
0. 14035 
0.13793 
0.13793 
0.13636 
0.13333 
0.13333 
0.13043 
0.13021 
0.12903 
0.12000 


N 
k 

84 
49 
87 
41 
12 
61 
31 
31 
31 
82 
33 
20 
88 
75 
55 
57 
29 
29 
22 
45 
30 
23 
192 
31 
25 


X 


Ik 
3 

1 

2 

0 

0 

1 
0 
1 
1 
0 
0 
0 

1 

2 
0 

1 
0 

1 

0 

1 

0 
0 
3 

1 
0 


2k 

1 

2 
3 
3 

1 
2 
1 
0 
0 
3 
2 
1 
2 
O 
3 
1 
2 
O 
1 
1 
2 
1 
4 
0 
1 


X 


3  k 
2 

1 

1 

1 

0 

2 

3 

1 

1 

7 

1 

1 

5 

3 

2 

2 

O 

0 

1 

0 

o 

1 

5 
O 

1 
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Table    V.       SCORSORT   SUMMARY    (continued) 


k 

S 

k 

N 
k 

X 
Ik 

X 
2k 

X 
3k 

201 

0.11765 

51 

0 

2 

2 

• 

0.11429 

35 

1 

0 

0 

• 

0.11250 

80 

1 

1 

3 

• 

0.11111 

99 

1 

2 

3 

0.11111 

81 

1 

2 

1 

0.11111 

63 

0 

3 

1 

0.11111 

45 

0 

1 

3 

0.11111 

45 

0 

2 

1 

0.11111 

36 

1 

0 

0 

0.11111 

27 

0 

1 

1 

0.11111 

9 

0 

0 

1 

0.10870 

46 

0 

1 

3 

0.10417 

48 

0 

2 

1 

0.09756 

41 

1 

0 

0 

0.08889 

45 

1 

0 

0 

0.08824 

68 

0 

3 

0 

0.08333 

84 

0 

3 

1 

0.08333 

72 

1 

0 

2 

0.08197 

61 

1 

0 

1 

0.08197 

61 

1 

0 

1 

0.07843 

51 

0 

1 

2 

• 

0.07692 

52 

0 

2 

0 

• 

0.07547 

106 

0 

3 

2 

• 

0.07143 

28 

0 

1 

0 

225 

0.07143 

14 

0 

0 

1 
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Table  V.   SCORSORT  SUMMARY  (continued) 


k 

sk 

N 
k 

X 
Ik 

X 
2k 

X 
3k 

226 

0.06897 

29 

0 

0 

2 

• 

0.06818 

44 

0 

1 

1 

• 

0.06780 

59 

0 

2 

0 

• 

0.06522 

92 

0 

2 

2 

0.06522 

46 

0 

1 

1 

0.06250 

16 

0 

0 

1 

0.06122 

49 

0 

1 

1 

0.06098 

82 

0 

1 

3 

0.06000 

50 

0 

1 

1 

0.05882 

34 

0 

1 

0 

0.05714 

35 

0 

1 

0 

0.05263 

19 

0 

0 

1 

0.05263 

19 

0 

0 

1 

0.05128 

39 

0 

0 

2 

0.05000 

60 

0 

0 

3 

0.04444 

45 

0 

0 

2 

0.03704 

54 

0 

0 

2 

0.03390 

59 

0 

0 

2 

0.03333 

30 

0 

0 

1 

0.03333 

30 

0 

0 

1 

0.03030 

66 

0 

1 

0 

• 

0.03030 

33 

0 

0 

1 

• 

0.02941 

68 

0 

0 

2 

• 

0.02532 

79 

0 

1 

0 

250 

0.02273 

44 

0 

0 

1 
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Table  V.   SCORSORT  SUMMARY  (continued) 


k 
251 


275 


k 
0.02128 

0.01639 

0.01613 

0.01124 

0.01099 

0.00952 

0.00855 

0.00000 

0.00000 

0.00000 

0.00000 

0.00000 

0.00000 

0.00000 

0.00000 

0.00000 

0.00000 

0 . 00000 

0.00000 

0.00000 

0.00000 

0.00000 

0.00000 

0.00000 

0.00000 


N 
k 

47 
122 
62 
89 
91 
105 
117 
68 
64 
58 
58 
55 
49 
48 
46 
43 
39 
38 
34 
32 
28 
27 
25 
25 
23 


X 


Ik 
0 

0 

0 

0 

0 

0 

0 

0 

0 

0 

0 

0 

O 

O 

0 

0 

O 

0 

0 

O 

0 

0 

O 

0 

O 


2k 
0 

1 

O 

0 

0 

0 

0 

0 

0 

0 

o 
o 
o 

0 
0 
0 
0 
0 

o 

0 

o 
o 
o 

0 
0 


3k 
1 

0 

1 
1 

1 
1 
1 
o 

0 

o 

0 
0 
0 
0 
0 
0 
0 
0 
0 
0 

o 

0 
0 

o 
o 
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Table  V.   SCORSORT  SUMMARY  (continued) 


k 

S 

k 

N 
k 

X 

Ik 

X 

2k 

X 

3k 

276 

0.00000 

22 

0 

0 

0 

• 

0.00000 

21 

0 

0 

0 

• 

0.00000 

19 

0 

0 

0 

• 

0.00000 

19 

0 

0 

0 

0.00000 

17 

0 

0 

0 

0.00000 

16 

0 

0 

0 

0.00000 

16 

0 

0 

0 

0.00000 

14 

0 

0 

0 

0.00000 

14 

0 

0 

0 

0.00000 

12 

0 

0 

0 

0.00000 

11 

0   ' 

0 

0 

• 

0.00000 

7 

0 

0 

0 

• 

0.00000 

5 

0 

0 

0 

• 

0.00000 

1 

0 

0 

0 

290 

0.00000 

1 

0 

0 

0 
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4"  V** 

of  the  fraction  of  i    place  votes  awarded  to  teacher  K  from 

the  population  that  knew  him,  i=l,2,3;  k=l,2,..0   Therefore, 

in  order  to  have  S  >  S  ,  the  relationship 

k    kT 

WlVlk  +  W2V2k  +  W3V3k  >  WlVlk'+  W2V2k'  +  W3V3k'  >  K  *   K' 

must  hold.   Rearranging  yields, 

w  fy  -v   )  +  w  fv  -v   )  +  w  (v  -v  )   >o 

lVVlk   lk'  ;     2^  2k   2k* ;     3^  3k  3k' ; 

Now,  if  all  values  of  V.,  -  V.,  .  >  0,  with  at  least  one 
'  lk     ik'  —   ' 

value  in  which  the  equality  does  not  hold,  then  S,  >  S,  , 
regardless  of  the  value  of  W  and  teacher  K'  can  be  elimina- 
ted.  An  even  stronger  condition  would  be  met  if  all  values 

of  V.,  -  V.,  ,  >■  0.   This  condition  is  called  absolute 
ik     ik' 

dominance. 

For  example,  suppose  three  teachers  have  the  following 

values  of  V: 

TV  V  V 

k         lk  2k  3k 

1  .7825        .5377        .4114 

2  .7519        .5211        .4081 

3  .7263        .3862        .5622 

T      absolutely    dominates    T    ,    but    neither    Tn    nor    T      is 
1  2  13 

absolutely  dominated. 

Another  form  of  dominance  is  called  complete  dominance. 

This  would  occur  when  the  condition  w  >:  w  >;  w_  must  be 

violated  in  order  for  a  particular  instructor  to  win.   In 

the  above  example,  if  all  three  place  votes  were  given 

equal  weights,  the  extreme  example  which  still  maintains  the 

relationship  wn^  w  >  w^ ,  T,  would  still  have  a  higher  score 
1    2    3    1 

than  T^.   However,  if  a  weighting  vector  were  allowed  in 
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which  a  third  place  vote  is  worth  more  than  either  a  first 

or  a  second  place  vote,  T   would  have  a  higher  score  than 

3 

T  .   Since  this  is  the  only  case  in  which  T   can  win,  we  say 
1  3  '  - 

that  T   is  completely  dominated  by  T   and  can  also  be  elim- 
inated from  the  competition. 

In  order  to  invoke  these  conditions  of  dominance  and 
hence  further  reduce  the  number  of  possible  recipients  of 
the  award,  a  FORTRAN  program  called  "Dominance"   was  run  on 
those  faculty  members  having  the  top  25  scores  from 
"Scorsort".   The  results  are  listed  in  Table  VI.   The  AD  and 
CD  columns  list  the  results  of  the  absolute  dominance  and 
complete  dominance  tests,  respectively.   A  1  indicates  T, 
is  dominated  and  a  0  indicates  he  is  not.   As  can  be  noted, 
the  absolute  dominance  test  reduced  the  number  of  possible 
recipients  to  6  and  the  complete  dominance  further  reduced 
this  number  to  3. 

F.   PAIRED  COMPARISONS 

Since  all  students  were  not  exposed  to  the  same  instruc- 
tors, it  was  felt  that  it  might  be  of  interest  to  select 
combinations  of  two  of  the  three  undominated  instructors 
and  compute  their  scores  using  only  the  votes  of  those 
voters  who  indicated  knowing  them  both.   In  this  way  the 
scores  could  be  compared  to  substantiate  or  dispute  the 
relative  rankings  determined  using  the  votes  of  the  entire 


A  listing  of  "Dominance"  is  included  in  Appendix  B. 
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Table  VI.   DOMINANCE  TEST  RESULTS 


Tk 

V 
Ik 

V 
2k 

V3k 

AD 

CD 

1 

.30000 

.30000 

.13333 

0 

0 

2 

.38461 

.12820 

.07692 

0 

0 

3 

.26923 

.23076 

.11538 

1 

1 

4 

.30769 

.10256 

.20512 

0 

0 

5 

.26119 

.22388 

.11194 

1 

1 

6 

.24324 

.21621 

.18918 

o 

1 

7 

.25806 

.20430 

.13978 

0 

1 

8 

.31250 

.09375 

.04687 

1 

1 

9 

.26470 

.13725 

. 08823 

1 

1 

10 

.25000 

.16176 

.09558 

1 

1 

11 

.23076 

.15384 

.12820 

1 

1 

12 

.24489 

.10204 

.14285 

1 

1 

13 

.20833 

.12500 

.22916 

0 

1 

14 

.25806 

.06451 

.09677 

1 

1 

15 

.19444 

.16666 

.11111 

1 

1 

16 

.22222 

.11111 

.09722 

1 

1 

17 

.15000 

.25000 

. 10000 

1 

1 

18 

.21739 

.13043 

.04347 

1 

1 

19 

.21348 

.08988 

.08988 

1 

1 

20 

.17777 

.15555 

.08888 

1 

1 

21 

.17021 

.17021 

.08510 

1 

1 

22 

.18248 

.13138 

.10948 

1 

1 

23 

.16000 

.20000 

. 04000 

1 

1 

24 

.20833 

.08333 

.04166 

1 

1 

25 

.19354 

.06451 

.12903 

1 

1 
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population.      A    FORTRAN    program   called   "Comparison"      was    run 

and   the    scores   were    recomputed   for    T      vs.    T    ,    T      vs.    T    ,    and 

T      vs.    T„.       It    was    determined,    however,    that    Tn    and   T„    had 
2  4  14 

no    voters    in    common    and   there   did   not    exist    a    valid  basis 
for    comparison. 


A    listing    of    "Comparison"    is    included   in  Appendix  B 
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IV.   THE  SELECTION 

Upon  completion  of  the  aforementioned  score  computations 
and  tests  the  following  information  was  presented  to  the 
committee  for  their  consideration  and  selection  of  a 
winner : 

1.  Results  of  the  score  calculations 

2.  The  number  of  1st,  2nd  and  3rd  place  votes  received 
by  the  top  25  scorers 

3.  Results  of  the  dominance  tests  for  the  top  25 
scorers 

4.  Results  of  the  paired  comparisons 

5.  Extracts  of  the  comments  sections  of  ballots 
selecting  T-  ,  Tp ,  or  T.    in  first  place. 

After  discussion  and  deliberation,  the  committee 
unanimously  decided  to  recommend  to  the  Provost  that  the 
award  be  divided  equally  among  teachers  T-,  ,  T2 ,  and  T.. 
The  final  decision  of  the  Provost,  however,  was  to  present 
the  award  to  Professor  M.  F.  Reynolds  of  the  Department  of 
Physics  and  Chemistry. 
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V. 


FURTHER   ANALYSIS 


In  order  to  determine  if  any  one  academic  department  was 
predominant  among  the  top  50  or  bottom  50  scorers,  the  dis- 
tribution for  each  department  was  determined  and  the 
percentage   involved  of  each  department  was  calculated. 
Tables  VII  and  VIII  give  the  results  for  197.2  and  1973. 


Table  VII.   DISTRIBUTION  OF  TOP  50  SCORERS  -  1972  and  1973 


Dept . 
Electrical  Engr. 
Aeronautics 
Aviation  Safety 
Govt,  and  Humanities 
Mathematics 
Mechanical  Engr. 
Meteorology 
Oceanography 
Ops.  Rsch.  &  Admin.  Sci. 
Physics  &  Chem. 
NMSC 


1972 

Number  and  % 
Of  Department 


1973 

Number  and  % 
Of  Department 


5       ( 

,11.6%) 

6       < 

[15.8%) 

3       ( 

;i6.7%) 

4       | 

;i9.i%) 

1       | 

;25.0%) 

1       | 

;2o.o%) 

2       I 

[22.2%) 

1       ( 

;n.i%) 

8       I 

[18. 2%) 

8 

[18.6%) 

4       | 

[28.6%) 

4       | 

[23.7%) 

3       | 

[25.0%) 

4       | 

[28.6%) 

2       I 

[14.3%) 

1       | 

;  7.1%) 

1       { 

[14.7%) 

14       | 

[17. 1%) 

6       I 

;i3.3%) 

3       < 

[    8.8%) 

5       < 

[33.3%) 

4      | 

[30.8%) 
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Table  VII.   DISTRIBUTION  OF  BOTTOM  50  SCORERS  -  1972  &  1973 


1972 

Number  and  % 
Of  Department 


1973 

Number  and  % 
Of  Department 


Dept. 
Electrical  Engr. 
Aeronautics 
Aviation  Safety 
Govt,  and  Humanities 
Mathematics 
Mechanical  Engr. 
Meteorology 
Oceanography 
Ops.  Rsch.  &  Admin.  Sci. 
Physics  &  Chem. 
NMSC 

It  is  interesting  to  note  that  the  top  10  scorers  of 
1972  represented  9  different  departments  and  the  top  10 
scorers  of  1973  represented  7  different  departments.   This 
would  appear  to  indicate  that  the  selection  process  was 
successfully  selecting  the  top  man  in  each  department  but 
that  placement  within  the  top  10  to  20  positions  occurred  on 
a  random  basis.   In  order  to  further  investigate  this 
possibility,  a  Spearman  Rank-Order  Correlation  (rho)  test 
was  performed  using  the  rankings  of  the  top  man  in  each 
department  in  1972  versus  the  rankings  of  the  top  man  in 
those  same  departments  in  1973. 
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DEPT.  DEPARTMENT  RANK      DEPARTMENT  RANK 

IN  1972  IN  1973 

Meteorology  1  11 

Mech.  Engr.  2  3 

Physics  &  Chem.  3  2 

Elec.  Engr.  4  4 

Avn.  Safety  5  6 

Aeronautics  6  8 

Mathematics  7  7 

Ops.  Rsch.  and  Admin.  Sci.  8  1 

Govt,  and  Humanities  9  9 

NMSC  10  5 

Oceanography  11  10 

6  5  D2 

The  statistic   rho  =  1  -  ^ was  computed  where 

N(N  -1) 

D  =  difference  in  ranking  of  each  dept .  in  1972  and  1973 
N  =  number  of  departments 

6  2d2  =  1092        N(N2-1)  =  1320 
rho  =  1  -  .828  =  .172 
Testing  the  significance  of  rho,  i.e.,  the  hypothesis 
that  rho  =  0,  the  t-statistic  with  9  degrees  of  freedom  is 
calculated  to  be 


_   .   /  N-2 
=  rhoi/ 

"   1-rh 


~5-    =   .169 
o^ 


which  is  not  significant  at  the  .05  level  of  significance 
and  the  hypothesis  is  not  rejected.   This  would  appear  to 
indicate  that  the  rankings  of  the  top  men  in  each  department 
in  1972  and  1973  were  randomly  distributed  within  the  first 
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twenty  scores.   Further  substantiation  of  this  hypothesis 
can  be  seen  by  noting  the  small  number  of  voters  that  the 
top  20  scorers  have  in  common.   Table  IX  is  a  matrix 
depicting  the  number  of  voters  in  common  among  the  top  20 
scorers  in  1973.   It  can  easily  be  seen  that  in  most  cases 
where  teachers  are  in  different  departments,  the  number  of 
students  in  common  is  quite  small.   In  order  to  facilitate 
comparison,  the  following  is  a  list  of  those  teachers  among 
the  top  20  who  are  in  the  same  department: 

1,  5,  18 

2,  8 
3,  11,  14 

6,  15 
9,  10,  19 
12,  17 
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Table    IX.       NUMBER    OF  COMMON    VOTERS   AMONG   TOP   20   SCORERS    1973 

02005000010110010622 
20012057676234091373 

000  1  0023  1  2  17  20  15  022041 
0110000  1115110  1000000 
520006  17  2652011752531 
00006081100100  32  00000 
0520  17  8054638  12  27  18  1332 
073  11  2150785306082093 
061       1       6      1      470   27      65      040    13      1       12119 

1  72      5      5      068    27      0742      61      9      1       126    18 

06  17  1  2035  6705  2  22  05  4193 
1221018354500301  14  081 
130010  12  0022000030500 
04    15       1102646   22      300052053 

00007  32  70010000010000 
192050  18  8  13  95  135  101  116  20 
01202012114  14  02010021 
63005030111050010030 
27403039  21  26  9805  0  16  230  19 
23101023    19    18      3      1030   20      10    19      0 
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VI.   RECOMMENDATI ONS 

It  is  felt  that  the  present  system  can  be  used  effec- 
tively to  select  within  each  department  that  faculty  member 
considered  most  proficient;   however,  as  a  means  of  further 
definitive  selection,  the  present  system  is  considered 
inadequate.   The  following  two  proposals  are  presented  for 
consideration : 

A.   CONTINUATION  OF  PRESENT  SELECTION  METHOD 

The  present  method  can  be  continued  as  a  means  of 
selecting  the  top  scorer  in  each  department.   The  cash 
award  which  is  normally  presented  to  the  winner  can  be  used 
to  purchase  appropriate  engraved  plaques  or  other  memora- 
bilia which  could  be  presented  to  the  11  co-winners  at  the 
June  graduation  ceremonies. 

Should  the  present  selection  method  be  continued,  the 
following  modifications  are  recommended: 

1.   Faculty  members  should  not  be  permitted  to  vote. 
During  the  course  of  ballot  verification  numerous  faculty 
members  who  were  identified  by  their  signatures  on  the 
outside  envelope  were  found  to  have  voted  for  themselves. 
No  accurate  figures  were  kept  in  this  regard,  but  it  is 
estimated  that  25%  -  35%  of  faculty  member  ballots  fell 
into  this  category. 

The  average  number  of  eligible  faculty  identified 
in  Part  C  of  the  ballot  by  faculty  members  was  25.8.   These 
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figures  include  three  faculty  members  who  identified  119, 
115,  and  114  persons  in  Part  C.   Excluding  these  three  fig- 
ures from  the  calculations  reduces  the  average  number  to 
22.5.   Considering  the  fact  that  in  most  departments  faculty 
members  rarely  have  the  opportunity  to  witness  each  other  at 
work  in  the  classroom,  the  figure  of  22.5  appears  to  be 
quite  high.   This  would  indicate  that  personal  rather  than 
professional  familiarity  is  being  used  as  a  criterion  for 
filling  out  Part  C. 

2.  A  cover  letter  from  the  Superintendent  should  be 
included  with  all  distributed  ballots.   During  the  course 
of  the  year,  numerous  questionnaires  of  various  types  are 
distributed  to  students  in  their  SMC  boxes  by  other  officer 
students  attempting  to  use  the  responses  for  course  require- 
ment studies  or  theses.   Because  of  the  large  number 
involved,  many  of  the  questionnaires  find  their  way  to  the 
SMC  trash  containers.   Considering  the  fact  that  student 
response  was  less  than  50%,  it  is  felt  that  a  large  number 
of  the  unreturned  ballots  suffered  a  similar  fate.   A  cover 
letter  from  the  Superintendent,  identical  to  that  accompany- 
ing each  alumnus  ballot,  will  impress  on  each  student  that 
the  ballot  is  of  a  semi-official  nature  and  a  matter  in 
which  the  Superintendent  has  an  interest  and  should  increase 
student  participation. 

3.  The  headings  of  Parts  B  and  C  of  the  ballot  should 
be  revised.   Of  the  335  disqualified  ballots,  275  failed  to 
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identify  5  faculty  members  in  Part  C.   The  instruction  sheet 
accompanying  each  ballot  explains  the  procedure  to  be  fol- 
lowed, but  no  instructions  for  circling  the  identification 
numbers  of  at  least  5  faculty  members  appears  on  the  ballot 
itself.   Furthermore,  Part  B  should  follow  Part  C  in  order 
to  be  in  a  logical  sequence  since  Part  C  is  performed  prior 
to  Part  B. 

A  suggested  format  for  the  headings  of  Parts  B  and  C  is 
as  follows: 

PART  B  -  LIST  OF  ELIGIBLE  FACULTY  (ALL  FACULTY  WHO  HAVE 
TAUGHT  TWO  OR  MORE  COURSE  SEGMENTS  IN  CALENDAR 
YEAR  1973  EXCEPT  CURRICULA R  AND  LIAISON  OFFI- 
CERS, MEMBERS  OF  THE  SELECTION  COMMITTEE  AND 
PRIOR  WINNERS) 

ENCIRCLE  THE  FOUR-DIGIT  IDENTIFICATION  NUMBER 
OF  ALL  THOSE  WITH  WHOSE  TEACHING  ABILITY  YOU 
ARE  SUFFICIENTLY  ACQUAINTED  TO  MAKE  A  JUDGMENT. 
DO  NOT  CONTINUE  TO  PART  C  UNLESS  YOU  HAVE 
ENCIRCLED  AT  LEAST  FIVE  NUMBERS. 

PART  C  -  NOMINATIONS  (INSERT  A  FOUR-DIGIT  FACULTY 

IDENTIFICATION  NUMBER  IN  EACH  BLANK).   WRITE- 
IN  VOTES  ARE  NOT  ACCEPTABLE. 

4.  The  following  four-digit  identification  numbers 

should  be  changed  in  order  that  the  fourth  digit  conform  to 

the  method  discussed  in  Part  II,  D  of  this  paper: 

2552  to  2556 

5244  to  5249 

5200  to  5205 

5211  to  5216 

5222  to  5227 

5.  A  number  of  instructors  who  should  have  been 
included  were  inadvertently  omitted  from  the  ballot  and 
conversely,  the  ballot  contained  the  names  of  some  ineligible 
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faculty  members.   A  thorough  check  must  be  made  to  insure 
that  all  eligible  faculty  members  are  included. 

6.   The  designator  for  Professor  under  Faculty  Rank 
should  be  PR  in  lieu  of  RP  and  the  designator  EE  for 
Electrical  Engineering  should  be  included  under  Faculty 
Department . 

B.   ADOPTION  OF  A  NEW  SELECTION  SYSTEM 

In  order  to  attempt  to  select  the  one  best  teacher  in 
the  school,  it  is  recommended  that  the  present  system  be 
replaced  by  one  employing  a  new  methodology.   What  is 
required  is  a  system  whereby  faculty  members  can  be  judged 
by  different  populations  on  the  basis  of  various  teacher 
qualities  or  characteristics.   If  the  scales  for  judgment 
were  identical,  all  faculty  members  could  then  be  compared 
on  the  basis  of  their  total  scores  divided  by  the  total 
number  of  evaluations.   A  problem  inherent  in  this  technique, 
however,  is  the  selection  of  those  descriptions  of  a  teach- 
er's classroom  behavior  which  are  highly  correlated  to  the 
student's  overall  concept  of  effective  teaching.   Examina- 
tion of  the  various  forms  used  by  schools  throughout  the 

nation  to  evaluate  teacher  performance  indicates  a  lack  of 

7 
agreement  on  what  characteristics  are  important.    Conse- 
quently, work  was  done  at  the  University  of  Washington  by 
Grace  M.  French  in  an  attempt  to  select  those  teacher 


7 

French,  G.M.,  College  Students'  Concept  of  Effective 

Teaching  Determined  by  an  Analysis  of  Teacher  Ratings ,  Ph . D . 

Thesis,  University  of  Washington,  1957,  p,  2. 
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characteristics  best  suited  to  reflect  what  students  con- 
sider important  for  teacher  effectiveness.   A  student 
questionnaire  was  devised  which  consisted  of  41  items 
gathered  from  forms  in  use  throughout  the  country  and  each 
student  was  asked  to  judge  his  instructor  on  a  five  point 
scale  on  each  of  the  items  listed  as  well  as  to  provide  an 
overall  judgment  of  the  teacher.   The  41  items  were  regarded 
as  independent  variables  and  the  overall  judgment  as  the 
dependent  variable.   It  was  then  determined  what  relation- 
ship exists  between  the  system  of  independent  variables  and 
the  dependent  variable;   i.e.,  the  relative  contribution  of 
each  item  to  the  overall  judgment.   This  was  measured  as  the 

product  of  B-r.   where 
r  i  1C 

B.  =  regression  weight  for  the  i    item 

th       8 
r.  =  validity  coefficient  for  the  i    item 

1C 

The  top  25  items  in  the  order  of  highest  contribution  are 
listed  in  Appendix  C. 

It  is  recommended  that  a  student  opinion  questionnaire 
be  devised  for  use  at  the  Naval  Postgraduate  School  using 
the  25  items  listed  in  Appendix  C.   Since  each  item  varies 
in  its  contribution  to  overall  judgment,  a  system  of  weights 
should  be  devised  for  each  of  the  items  in  proportion  to  its 
relative  value.   A  specified  portion  of  class  time  at  the 
end  of  each  quarter  could  be  allotted  for  completion  of  the 


o 

Validity  is  defined  in  French,  p.  25,  as  the  corre- 
lation between  a  predictor  and  that  which  is  being 
predicted.   No  further  explanation  of  r.   could  be  found. 

1C 
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questionnaire  by  all  students  and  a  score  compiled  for  each 
faculty  member  which  would  be  updated  each  quarter.   In 
addition  to  selection  of  the  annual  excellence  in  teaching 
award  recipient,  a  form  such  as  that  proposed  could  be  used 
in  conjunction  with  classroom  visitation  appraisals  by 
heads  of  departments  as  well  as  publication  accomplishments 
to  assist  in  making  decisions  regarding  promotions  or 
tenure. 
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APPENDIX  A 


BALLOT 


PART  A  -  STATISTICAL  (ENCIRCLE  APPROPRIATE  CODE  IN  EACH  SECTION) 

VOTER  CATEGORY 


S   STUDENT 

A   ALUMNUS 

F   FACULTY 

C 

CURRICULAR  OFFTC 

STUDENT/ ALUMNUS/ 

CURRICULAR 
Military 

OFFICER 

FACULTY 

Branch  of  Service 

Rank 

Curricular  Area 

Rank 

Department 

N   Navy 

01 

30 

Ops  Analysis 

IR 

Instructor 

AE 

Aeronautics 

M   Marine  Corps 

02 

31 

Aero  Eng 

AT 

Assistant  Prof. 

AO 

Aviation  Safety 

A   Army 

03 

32 

Elec  &  Comm  Eng 

AC 

Associate  Prof. 

MN 

Bus  Ad  &  Econ 

C   Coast  Guard 

Ok 

33 

Phys  Sci  &  Sys  Tech 

RP 

Professor 

GH 

Govt  &  Humanities 

L   Air  Force 

05 

(Formerly  Ordnance) 

MA 

Math 

F   Foreign 

06 

& 

Naval  Eng  &  Eng  Sci 

ME 

Mech  Eng 

X   Civilian 

07 

35 

Env  Sci 

MR 

Meteorology 

36 

Mgmt  &  Compt  Sci 

OC 

Oceanography 

38 

Baccalaureate 

OA 

Ops  Analysis 

39 

Def  Management 

J>H 
KB 

Physics  it.   Chem 
Navy  Mgmt  Sys 

PART  B  -  NOMINATIONS  (INSERT  A  FOUR  DIGIT  FACULTY  IDENTIFICATION  NUMBER  IN  EACH  BLANK) 


FIRST  CHOICE 


SECOND  CHOICE 


THIRD  CHOICE 


PART  C  -  LIST  OF  ELIGIBLE  FACULTY  (ALL  FACULTY  WHO  HAVE  TAUGHT  TWO  OR  MORE  COURSE  SEGMENTS  IN  CALENDAR  YEAR  1972, 
EXCEPT  CURRICULAR  AND  LIAISON  OFFICERS  AND  MEMBERS  OF  THE  SELECTION  COMMITTEE) 


AVIATION  SAFETY  PROGRAMS 

101U  Bomberger,  R.  B. 

1025  Bradbury,  C.  M. 

5016  Branson,  J.  J. 

551*1*     Nielsen,   J.   C. 
1047     Wible,    L.   C. 
DEPARTMENT  OF  AERONAUTICS 


1058 

Ball,  R.  E. 

5027 

Bank,  M.  H. 

5^50 

Bell,  R.  W. 

IO69 

Bennett,  J.A.J. 

1070 

Biblarz,  0. 

1081 

Collins,  D.  J. 

5V72 

Evans,  R.  M. 

5038 

Fuhs,  A.  E. 

1092 

Gawain,  T.  H. 

50i*9 

Hess,  R.  A. 

1119 

Kahr,  C.  H. 

1120 

Layton,  D.  M. 

1131 

Lindsey,  G.  H. 

111+2 

Miller,  J.  A. 

1153 

Netzer,  D.  W. 

5050 

Power,  H.  L. 

1175 

Redlln,  M.  H. 

1186 

Schmidt,  L.  V. 

51*61 

Shreeve,  R.  P. 

1197 

Vavra,  M.  H. 

1203 

Zucker,  R.  D. 

DEPARTMENT  OF  ELEC.   ENGR. 

ll*8l  Adler,   R.   W. 

506l  Bach,   R. 

1519  Baycura,   0.   M. 

1531  Bouldry,  J.   M. 

151*2  Breida,   S. 

1561*  Chan,   S. 

1586  Cooper,   P.   E. 

1597  Cotton,  M.    L. 

1625  Swing  G.   D. 

161*7  C-eist,  J.  M. 

1658  Gerba,  A.,   Jr. 

1669  Houston,   R.   K. 

1670  Kirk,   D.   E. 
l68l  Klamm,   C.   P., Jr. 
1*035  Knorr,  J.   B. 
1692  Marmont,   G.    H. 
1708  Miller,   R.   L. 
5083  Myers,   H.    L. 
51*1*9  Ohlson,  J. 

1753  Panholzer,   R. 

1*079  Powers,  J.    P. 

1*080  Powers,   V.   M. 

509l*  Price,   T.   G. 

176U  Rahe,   G.   A. 

1775  Rothauge,  C  -    H. 

1786  Sackman,   G.    L. 


1797 

Sheingold,  A. 

511*1* 

Brubaker,  R.  H. 

1803 

Smith,  W.  C. 

2167 

Budway,  J.  J. 

1811* 

Spaugy,  D.  A. 

2189 

Chewning,  W.  C. 

1825 

Stentz,  D.  A. 

2190 

Comstock,  C. 

1836 

Strum,  R.  D. 

2206 

Davis,  D.  L. 

181*7 

Terman,  F.  W. 

2217 

Dixon,  D.  R. 

1858 

Thaler,  G.  J. 

2228 

Estell,  R.  J. 

1869 

Titus,  H.  A. 

2239 

Faulkner,  F.  D. 

1870 

Turner,  J.  B. ,  Jr. 

221*0 

Franke,  R. 

51*38 

Wang,  C.  C. 

2251 

Giarratana  ,  J. 

1881 

Ward,  J.  R. 

2262 

Gibbons,  G.  D 

1892 

Wilcox,  M.  L. 

1*091 

Hanna,  R.  M. 

DEPARTMENT  OF  GOVT  &  HUMANITIES 

2295 

2301 

Jayachandran,  T 

1919 

Amos,  J.  W. ,  II 

Jennings,  W. 

1931 

Boggess,  W.  C. 

2312 

Kildall,  G.  A. 

1920 

Bjarnason,  L.  L. 

2323 

Kodres,  U.  R. 

5100 

Caldwell,  D.  E. 

2331* 

Kolitz,  B.  L. 

191*2 

Gabel,  B.  B. 

5166 

Kovach,  L.  D. 

1953 

Gottschalk,  S. 

5511 

Logan,  T.  J. 

5250 

Huff,  B.  R. 

2367 

Lucas,  K.  R. 

5261 

Ross,  G.  A. 

2378 

Marks,  H.  B. 

1997 

Smith,  B.M.L. 

2389 

Morris,  G.  W. 

DEPARTMENT  OF  MATHEMATICS 

5522 

Moore,  L.  R. 

5500 

Bamford,  R.  C. 

2390 

Pierce,  J.  P. 

2131* 

Bender,  A.  P. 

2U17 

Pulliam,  F.  M. 

211*5 

Bleick,  W.  E. 

5177 

Rice,  B. 

2156 

Bolles,  R.  C. 

2l*28 

Roberts,  A.  B. 
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DEPARTMENT  OF  MATHEMATICS 

5533  Russak,  I.  B. 

21*39  Schoenetadt,  A.  L. 

2^51  Shorb,  A.  M. 

2l*62  Singer,  E.  A. 

5188  singer,  S. 

2W*  Stewart,  E.  J. 

2U95  Stoops,  G.  A. 

2501  syms,  G.  .H. 

2512  Trahan,  D.  H. 

2523  Wang,  P.  C.  C. 

253*+  Weir,  M.  D. 

25>*5  Wilde,  C.  0. 

DEPARTMENT  OF  MECHANICAL  ENGR. 

2552  Brock,  J.  E. 

2567  Cantin,  G. 

2578  Cooper,  T.  E. 

5566  Edwards,  G.  R. 

2589  Garrison,  G.  J. 

2590  Houlihan,  T.  M. 
2606  Kelleher,  M.  D. 
2617  Marto,  P.  J. 
5577  McKinnon,  E.  A. 
2628  Newton,  R.  E. 
2639  Nguyen,  D.  H. 
5555  Nunn,  R.  H. 
5588  Perkins,  A.  J. 
261*0  Prowell,  R.  W. 

5199  Pucci,  P.  F. 
2651  Salinas,  D. 

5200  Sarpkaya,  T. 

DEPARTMENT  OF  METEOROLOGY 

2673  Alberty,  R.  L. 

2681+  Davidson,  K.  L. 

2712  Elsberry,  R.  L. 

1*107  Haltiner,  G.  J. 

2723  Hamilton,  H.  D. 

5211  Haney,  R.  L. 

27l*5  Martin,  F.  L. 

2756  Oakes,  W.  B. 

1*118  Renard,  R.  J. 

2767  Schardt,  D.  L. 

2778  Taylor,  C.  L. 

5l»9l*  Tr acton,  M.  S. 

2789  Van  der  Bijl,  W. 

7001  Williams,  R.  T. 

DEPARTMENT  OF  OCEANOGRAPHY 

2806  Andrews,  R.  S. 

5272  Bechelmayr,  L.  R. 

2828  Boston,  N.  E.  J. 

5222  Bourke,  R.  H. 

281*0  Denner,  W.  W. 

2851  Gait,  J.  A. 

2895  Jung,  G.  H. 

1*130  Paquette,  R.  G. 

521*1*  Roberts,  C.  K. 

2912  Thompson,  W.  C. 

2923  Thornton,  E.  B. 

293U  Traganza,  E.  D. 

2956  von  Schwind,  J.  J. 

2967  Wickham,  J.  B. 


DEPARTMENT  OF  OPS  RES  &  ADM  SC 
53H  Abbey,  D.  L. 
2978  Andrus,  A.  F. 

2989  Arima,  J.  K. 
OO66  Barden,  R.  S. 

2990  Barr,  D.  R. 
0105  Bedow,  R.  J. 
3010  Brill,  E.  A. 

3021  Butterworth,  R.  W. 
3032  Burnett,  T.  D. 
5355  Burns,  D.  C. 
30l*3  Capra,  J.  R. 
1211+  Carrick,  P.  M. 
1225  Church,  W.  H. 
5283  Corcoran,  A.  W. 
0077  Courtney,  D. 
1*013  Creighton,  J.  W. 
305I*  Cunningham,  W.  P. 
121+7  Derbyshire,  L. 
5333  DeMayo,  P. 
1258  Eisenhardt,  P. 

1269  Elster.R.  S. 
3076  Esary,  J.  D. 
3098  Floyd,  J.  A. 
5399  Folsom,  R.  N. 
3115  Forrest,  R.  N. 
3101*  Free,  W.  D. 

1270  Fremgen,  J.  J. 
3126   Gaver,  D.  P. 
1292   Githens,  W.  H. 
1308  Grainger,  T.  L. 
3ll*8  Greenberg,  H. 
529I*  Haga,  W.  J. 
5300  Hampton,  D.  R. 
1*091  Hanna,  M. 

3160  Heidorn,  G.  E. 
3171  Higgins,  J.  E. 
OO88  Horton,  F.  C. 

1319  Hoverland,  H.  A. 
3182  Howard,  G.  T. 

1320  Hynes,  J.  P. 
1331  Jolly,  J.  A. 
0099  King,  G.  J. 
39I+8  Kline,  M.  B. 
1353  Lande,  R.  S. 
1361*  Lane,  H.  L. 
1375  Lee,  M.  H. 
1*11*1  Lewis,  P.  A.  W. 
321*3  Lindsay,  G.  F. 
3265  Marshall,  K.  T. 
1386  McDonald,  J.  H. 
3251*  McMasters,  A.  W. 
3276  Milch,  P.  R. 
51+05  Neil,  D.  E. 
5427  Overbay,  W.  A. 
3287  Peterson,  C.  A. 
3298  Poock,  G.  K. 
3301*  Preston,  F.  L. 
0116  Ralke,  W.  M. 
3315  Richards,  F.  R. 
1*01*6  Schneidewind,  N.  F. 
3326  Schrady,  D.  A. 


5366  Schumann,  J.  F. 

0127  Senger,  J.  D. 

331*8  Shubert,  B.  0. 

3359  Shudde  ,  R.  H. 
5l*l6  Smith,  J.  H. 

3360  Sovereign,  M.  G. 
ll*25  Steckler,  M.  J. 
5322  Stephen,  R.  A. 
5377  Tate,  T. 

3382  Teylor,  J.  G. 

5388  Teresawa,   K. 

0ll*9  Thomas,  M.  D. 

31*09  Tysver,   J.    B. 

31*10  Washburn,   A.   R. 

ll*58  Wegener,   W.   H. 

0l6l  Weitzman,   R.   A. 

0172  Whipple,   D. 

ll*70  Womer,   N.    K. 

531*1*  zabrycki,   E.   A. 

31*32  Zehne,   P.   W. 

31+1+3  Zweig,   H.   J. 

DEPARTMENT  OF  PHYSICS  &  CHEM 

3l*5l*  Armstead,   R.    L. 

3U65  Buskirk,  F.  R. 

31*76  Ceglio,  N.  M. 

3U87  Cooper,  A.  W. 

31*98  Cooper,  J.  N. 

35OI*  Coppens,  A.  B. 

3515  Crittenden,  E.  C. ,  Jr. 

3526  Dahl,  H.  A. 

0183  Dally,  E.  B. 

3537  Eller,  A.  I. 

35l*8  Garrettson,  G.  A. 

3559  Handler,  H.  E. 

5lt83  Heim,  ft. 


3571     Kalmbach,   S.   H. 
3582     Kelly,   R.    L. 
019I*     Maruyama,   X.   K. 
3621     Medwin,   H. 
3632     Milne,  E.   A. 
361*3     Neighbours,  J.    R. 
365I*     Olsen,    L.   0. 
3665     Reese,  W. 
2073     Reinhardt,   R.   A. 
2081*     Reynolds,  M.   F. 
3687     Rodeback,G.   W. 
2095     Rowell,   C.    F. 
3701+     schecher,  G.   E. 
5122     Schultz,  J.   W. 

3715     Schwirzke,   F.   R. 

2101     Sinclair,  J.   E. 

2112     Tolles,   W.   M. 

3726  Williamson,  T.  J. 

7012  Wilson,  0.  B. ,  Jr. 

3737  Woehler,  K.  E. 

37U8  Zeleny,  W.  B. 

NAVY  MANAGEMENT  SYSTEMS  CENTER 

3759  Blendin,  S.  W. 

3760  Boynton,  R.  E. 
0200  Callahen,  J.  F. 
0211  Campbell,  W.  A. 
3782  Childs,  F.  E. 
3793  Dawson,  J.  E. 
3810  Dor an,  E.  J. 
5599  Ecker,  H.  P. 
3821  Freed,  E.  J. 
385I*  Mauer,  W.  A. 
3898  Ulrey,  I.  W. 

3887  von  Pegenhardt,  R. 
3901*  Wood,  C.  L. 


PART  D  -  SUPPORTING  REMARKS  FOR  YOUR  PRIMARY  NOMINATION 
(OPTIONAL) 
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AWARD  FOR  EXCELLENCE  IN  TEACHING 


In  order  to  augment  the  existing  incentives  for  teaching  of  high 
quality,  an  Award  for  Excellence  in  Teaching  has  been  established  by  the 
Superintendent.   A  substantial  stipend  was  made  possible  through  a  gift 
to  the  Naval  Postgraduate  School  Foundation  in  honor  of  Rear  Admiral 
John  J.  Shieffelin,  USN.   The  judgments  of  those  who  have  participated 
in  the  educational  processes  at  the  Naval  Postgraduate  School  are  of 
primary  importance  in  determining  the  recipients.   This  poll  is  being 
conducted  to  assess  the  collective  opinion  of  students,  faculty,  staff, 
and  selected  alumni.  After  accumulating  and  processing  the  voting 
results,  the  Selection  Committee  will  make  its  recommendations  to  the 
Superintendent . 

A  meaningful  selection  of  the  Award  recipients  is  heavily  dependent 
upon  input  from  a  large  portion  of  the  eligible  voters.   Your  response 
is  therefore  earnestly  requested.   Please  complete  the  enclosed  ballot 
in  accordance  with  the  instructions  below.   The  results  of  the  polling, 
other  than  the  name  of  the  Award  recipients,  will  be  treated  as 
privileged  information. 

BALLOTING  PROCEDURE: 

Step  1.  Complete  the  information  requested  at  the  top  (Part  A)  of  the 
ballot.  These  items  are  for  purposes  of  statistical  analyses 
only. 

Step  2.   On  the  list  of  eligible  faculty  (Part  C) ,  encircle  the  four- 
digit  identification  number  at  the  left  of  all  those  with  whom 
you  are  sufficiently  acquainted  to  make  a  judgment.   If  you  have 
circled  five  or  more  numbers  on  the  ballot,  proceed  to  Step  3. 
Otherwise,  please  return  your  ballot  as  directed  in  Step  5. 

Step  3-   From  the  subset  of  faculty  you  have  indicated  in  Step  2,  select 
from  one  (l)  to  three  (3)  nominees.   Indicate  your  preferences 
in  order  by'placing  the  four-digit  identification  numbers  of 
your  nominees  for  first,  second  and  third  choices  in  the  appro- 
priate spaces  provided  in  Part  B. 

Step  k.     You  are  invited  to  furnish  a  short  statement  in  support  of  your 
primary  nomination.   Indicate  those  qualities  which,  in  your 
judgment,  make  him  an  outstanding  teacher.   Space  is  provided 
for  this  at  the  end  (Part  D)  of  the  ballot. 

Step  5.   Place  your  completed  ballot  in  the  enclosed  return  envelope, 
sign  the  envelope  and  return.   To  be  counted  ballots  must  be 
received  by  15  April  1973.   Ballots  will  be  separated  from  the 
envelopes. 
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NAVAL  POSTGRADUATE  SCHOOL 

MONTEREY.  CALIFORNIA  -  93940  in  reply  refer  to: 


Dear  Alumnus : 

This  June  awards  for  excellence  in  teaching  for  the  third 
time  will  be  given  to  members  of  our  faculty,  civilian  or  mili- 
tary.  These  will  include  the  Rear  Admiral  John  J.  Shieffelin 
Award,  made  possible  through  a  grant  to  the  Naval  Postgraduate 
School  Foundation.   Previous  winners  of  the  award  are  Professor 
John  N.  Dyer  of  the  Department  of  Physics,  Professor  Eugene 
C.  Haderlie  of  the  Department  of  Oceanography  and  Assistant  Pro- 
fessor Ronnie  L.  Alberty  of  the  Department  of  Meteorology.   The 
recipients  are  determined  each  year  through  a  careful  poll  taken 
among  alumni,  students  and  faculty. 

In  recognition  of  the  fact  that  some  of  the  qualities  in- 
herent in  teaching  excellence  may  not  be  manifest  to  the  student 
until  certain  experiences  have  been  afforded  in  the  field,  we 
again  seek  an  input  to  the  poll  from  graduates. 

Your  year  group  has  been  selected  as  one  which  should  have 
had  time  to  evaluate  the  quality  of  your  instruction  here  without 
being  too  far  removed  to  recall  the  experience  clearly. 

Would  you  be  kind  enough  to  read  the  accompanying  material 
and  make  your  selections?   It  would  be  greatly  appreciated. 

Sincerely, 

A{AS0N  FREEMAN 

Re^ar  Admiral,   U.    S.    Navy 

Superintendent 

Ends . 
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APPENDIX  C 
RANK-ORDERED    ITEMS    OF    STUDENT  EVALUATION 


B.r 
i    ic 


1.  Interprets  abstract  ideas  and  theories  clearly  .038 

2.  Gets  students  interested  in  his  subject.  .037 

3.  Has  increased  my  skills  in  thinking.  .034 

4.  Has  helped  broaden  my  interests.  .031 

5.  Stresses  important  material.  .030 

6.  Makes  good  use  of  examples  and  illustrations.  .030 

7.  Motivated  me  to  do  my  best  work.  .029 

8.  Inspires  class  confidence  in  his  knowledge  .029 
of  the  subject. 

9.  Has  given  me  viewpoints  or  appreciations.  .029 

10.  Is  clear  and  understandable  in  his  explanations.  .028 

11.  Seems  to  enjoy  teaching.  .028 

12.  Has  presented  many  thought-provoking  ideas.  .028 

13.  Has  given  me  new  tools  for  attacking  problems.  .028 

14.  Has  made  the  course  sufficiently  difficult  to  .026 
be  stimulating. 

15.  Keeps  the  balance  between  discussion  and  lecture  .022 
well  suited  to  this  type  of  course. 

16.  Teaches  near  the  class  level.  .022 

17.  Has  an  adequate  speaking  voice.  .022 

18.  Makes  the  course  practical.  .022 

19.  Shows  interest  and  enthusiasm  in  his  subject.  .022 

20.  Controls  class  discussion  to  prevent  rambling  .020 
and  confusion. 

21.  Has  maintained  an  atmosphere  of  good  feeling  in  .020 
the  class. 
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Biric 

22.  Gives  well  organized  lectures.  .019 

23.  Encourages  initiative  on  the  part  of  the  .018 
students. 

24.  Has  a  good  sense  of  humor.  .018 

25.  Has  been  well  prepared  for  each  day's  lecture.     .017 


72 


LIST  OF  REFERENCES 


1.  Bruning,  J.L.  and  Kintz,  B.L.,  Computational  Handbook  of 

Statistics,  pp.  156-159,  Scott,  Foresman  and  Company, 
1968. 

2 .  Ca pps ,  J . H . ,  The  Second  Annual  Award  for  Excellence  in 

Teaching.   An  Analysis  of  Procedure  and  Data ,  M . S . 
Thesis,  U.S.  Naval  Postgraduate  School,  Monterey 
California,  1971. 

3.  French,  G.M.,  College  Students'  Concept  of  Effective 

Teaching  Determined  by  an  Analysis  of  Teacher 

Ratings ,  Ph.D.  Thesis,  University  of  Washington,  1957, 

4.  Miller,  R.I.,  Evaluating  Faculty  Performance,  Jossey- 

Bass  Inc. ,  1972. 

5.  Scango,    P.D.,    The    Third  Annual   Award    for    Excellence    in 

Teaching.       An   Analysis    of    Procedure    and    Data,    M.S. 
Thesis,    U„S.    Naval    Postgraduate    School,    Monterey, 
California,    1972. 


73 


INITIAL   DISTRIBUTION    LIST 

No.    Copies 

1.  Defense  Documentation  Center  2 
Cameron  Station 

Alexandria,  Virginia 

2.  Library,  Code  0212  2 
Naval  Postgraduate  School 

Monterey,  California  93940 

3.  Assoc.  Professor  H.  Zweig,  Code  55  Zw  2 
Department  of  Operations  Research 

and  Administrative  Sciences 
Naval  Postgraduate  School 
Monterey,  California  93940 

4.  LTC    Philip   Victor    Di    Mauro,    USA  1 
8100  Springfield  Village  Drive 

Springfield,   Virginia  22152 

5.  Chief   of   Naval    Personnel  1 
Pers-llb 

Department  of  the  Navy 
Washington,  D.C.  20370 

6.  Associate  Professor  Norman  Plotkin  11 
Navy  Management  Systems  Center 

Naval  Postgraduate  School 
Monterey,  California  93940 

7.  Naval  Postgraduate  School  1 
Department  of  Operations  Research  and 

Administrative  Sciences 
Monterey,  California  93940 


74 


Security  Classification 


DOCUMENT  CONTROL  DATA  -R&D 

(Security  clas sil ic ation  ol  title,    body  ol  abstract  and  indexing  annotation  musf  be   entered  when   the  overall  report  Is  classified) 


1     ORIGIN*  TINS    ACTIVITY   (Corporate  author) 

Naval  Postgraduate  School 
Monterey,  California  93940 


21.  REPORT    SECURITY    CLASSIFICATION 

Uncla  ssif ied 


2b.    CROUP 


3      REPORT     TITLE 


The    Fourth  Annual   Award   for    Excellence   in    Teaching 
An   Analysis    of    Procedure    and    Data 


4.    DESCRIPTIVE   NOTES  (Type  ol  report  end.lnclus  ive  dates) 


I     au  THOR(S)  (first  name,  middle  Initial,  last  name) 


Philip   V.    Di    Mauro 


6      REPORT    DATE 


September    1973 


la.     TOTAL    NO.    OF    PACES 


76.    NO.    OF    REFS 


»«.    CONTRACT    OR    GRANT    NO. 


b.    PROJEC  T    NO. 


6a.    ORIGINATOR'S    REPORT    NUMBER!*) 


lb.   OTHER   REPORT  NOISI  (Any  other  numbers  that  may  be  assigned 
this  report) 


10.    DISTRIBUTION    STATEMENT 


Approved  for  public  release;  distribution  unlimited, 


II.    SUPPLEMENTARY    NOTES 


12.    SPONSORING   MILITARY    ACTIVITY 


Naval  Postgraduate  School 
Monterey,  California  93940 


13.  ABSTRACT 


The  purpose  of  this  thesis  was  to  present  the  procedure 
and  techniques  used  to  select  the  fourth  annual  recipient  of 
the  Rear  Admiral  John  J.  Shieffelin  Award  for  Excellence  in 
Teaching.   The  data  and  results  were  analyzed  and  compared 
with  the  results  from  the  previous  year.   Findings  indicate 
that  the  best  teacher  in  each  of  the  eleven  academic  depart- 
ments is  being  selected  but  that  distribution  of  the  eleven 
within  the  top  twenty  positions  occurs  randomly. 

Recommendations  were  made  for  changes  in  the  present 
system  should  it  continue  in  use  and  an  additional 
recommendation  was  made  for  the  adoption  of  a  new  method  of 
selection  based  on  the  use  of  student  questionnaires. 


DD  ,f°„l"..1473    <PAGE  " 


FORM 

I    NOV 

S/N    0101 -807-681  1 


75 


Security  Classification 


i-ai 


Security  Clcislfiretion 

— — 1 — — —— «m  —  ■ 


KEY     WOKDI 


Teacher   Evaluation 


DD  ,?r..1473  'back, 


5/N  0101-807-6821 


76 


Security  Classification 


A- 31 409 


Thesi s 

D5764 

c.l 


•«    ;    -» -i 


"    '     "7  i         o 

Di    Mauro 

The  fourth  annual 
award  for  excellence  in 
teaching.  An  analysis 


CO 

3  10  7  7 

/ 

Thesis 

1A7120 

D5764 

D 

Maurc 

» 

c.l 

The 

fourth 

annual 

award 

for 

excel lence    in 

teachi 

ng. 

An  analysi  s 

of  procedi 

j  re 

and 

data. 

thesD5764 

Ti.,Slf,?.nualawardfor  excellence, 


3  2768  000  98527  9 

DUDLEY  KNOX  LIBRARY 


